Features for Cross Spectral Image Matching: A Survey

In recent years, cross spectral matching has been gaining attention in various biometric systems for identification and verification purposes. Cross spectral matching allows images taken under different electromagnetic spectrums to match each other. In cross spectral matching, one of the keys for successful matching is determined by the features used for representing an image. Therefore, the feature extraction step becomes an essential task. Researchers have improved matching accuracy by developing robust features. This paper presents most commonly selected features used in cross spectral matching. This survey covers basic concepts of cross spectral matching, visual and thermal features extraction, and state of the art descriptors. In the end, this paper provides a description of better feature selection methods in cross spectral matching

Water Level Detection for Flood Disaster Management Based on Real-time Color Object Detection

Currently, the water level monitoring system for a river uses instruments installed on the banks of the river and must be checked continuously and manually. This study proposes a real-time water level detection system based on a computer vision algorithm. In the proposed system, we use color object tracking technique with a bar indicator as a reference’s level. We set three bar indicators to determine the status of the water level, namely NORMAL, ALERT and DANGER. A camera was installed across the bar level indicators to capture bar indicator and monitoring the water level. In the simulation, the monitoring system was installed in 5-100 lux lighting conditions. For experimental purposes, we set various distances of the camera, which is set of 40-80 centimeters and the camera angle is set of 30-60 degrees. The experiment results showed that this system has an accuracy of 94% at camera distance is in range 50-80 centimeters and camera angle is 60o. Based on these results, it can be concluded that this proposed system can determine the water level well in varying lighting conditions

Identifikasi Tingkat Kematangan Kelapa Sawit Berbasis Pencitraan Termal

Indonesia is the biggest producer of palm oil (Elaeis guineenis jacq).  The palm tree is a primary commodity that posses a high economic value. Palm oil must be considered in terms of quality to produce optimal and high-quality oil. Previously, the stipulation of the palm tree characterization used manual and visual image utilization method; it may have weaknesses due to the dependency of individual sorting and coruscation factor. Therefore, this research is aimed to improve the performance of the previous method in identifying the ripeness of palm tree based on thermal imaging. The excess of thermal imaging was not related to the coruscation since the level of ripeness was both determined by the temperature and colour. The detection method of this research deployed the colour-based features that are Dominant Colour Descriptor and Color Moment. The DCD  and Color Moment was the input to the K-Nearest Neighbor (KNN) method.  The percentage of identification rate was 89%, and the identification of oil palm maturity level using thermal imaging is more efficient because it is done without human intervention and does not depend on lighting assistance compared to manual method and method of using RGB visual images

Sistem Temu Kembali Citra Termal Kanker Payudara Pada Citra Rekam Medis

Medical record images (Medical Imaging) in the form of the thermal images can be able to detect of of breast cancer as early detector for the patient. The technic process is by utilizing the thermal image of an existing breast cancer patient, the thermal image of the new patient can be searched by the similarities the image of the old patient. In order to get the exactly results, required an accurate system to find the thermal imaging of breast cancer patients in the thermal image database. This study aims to build a Content Based Imaged Retrieval (CBIR) system for thermal images of breast cancer patients based on thermal images have been diagnosed by specialist doctors. This system with using a combination of color histogram features and dominant color descriptors. To determine the similarity between the query image and the dataset image with using of two methods that is measuring the Euclidean Distance and the Minkowski Distance. The results of this research show from testing the combination between the two features, the F-measure evaluation value obtained from the top 10 retrieval was in the healthy image category of 0.07 and 0.09 in the cancer image category. From the conducting testing process result, the concluded is the most appropriate feature in carrying out the breast thermal image retrieval process is using a combination of dominant color descriptor features and color histograms

Performance of ShuffleNet and VGG-19 Architectural Classification Models for Face Recognition in Autistic Children

This study discusses the face recognition of children with special needs, especially those with autism. Autism Spectrum Disorder (ASD) is a complex neurodevelopmental disorder that affects social skills, ways of interacting, and communication disorders. Facial recognition in autistic children is needed to help detect autism quickly to minimize the risk of further complications. There is extraordinarily little research on facial recognition of autistic children, and the resulting system is not fully accurate. This research proposes using the Convolution Neural Network (CNN) model using two architectures: ShuffleNet, which uses randomization channels, and Visual Geometry Group (VGG)-19, which has 19 layers for the classification process. The research object used in the face recognition system is secondary data obtained through the Kaggle site with a total of 2,940 image data consisting of images of autism and non-autism. The faces of autistic children are visually difficult to distinguish from those of normal children. Therefore, this system was built to recognize the faces of people with autism. The method used in this research is applying the CNN model to autism face recognition through images by comparing two architectures to see their best performance. Autism and non-autism data are grouped into training data, 2,540, and test data, as much as 300. In the training stage, the data was validated using validation data consisting of 50 autism image data and 50 non-autism image data. The experimental results show that the VGG-19 has high accuracy at 98%, while ShuffleNet is 88%

A Deep Learning Method for Early Detection of Diabetic Foot Using Decision Fusion and Thermal Images

Diabetes mellitus (DM) is one of the major diseases that cause death worldwide and lead to complications of diabetic foot ulcers (DFU). Improper and late handling of a diabetic foot patient can result in an amputation of the patient’s foot. Early detection of DFU symptoms can be observed using thermal imaging with a computer-assisted classifier. Previous study of DFU detection using thermal image only achieved 97% of accuracy, and it has to be improved. This article proposes a novel framework for DFU classification based on thermal imaging using deep neural networks and decision fusion. Here, decision fusion combines the classification result from a parallel classifier. We used the convolutional neural network (CNN) model of ShuffleNet and MobileNetV2 as the baseline classifier. In developing the classifier model, firstly, the MobileNetV2 and ShuffleNet were trained using plantar thermogram datasets. Then, the classification results of those two models were fused using a novel decision fusion method to increase the accuracy rate. The proposed framework achieved 100% accuracy in classifying the DFU thermal images in binary classes of positive and negative cases. The accuracy of the proposed Decision Fusion (DF) was increased by about 3.4% from baseline ShuffleNet and MobileNetV2. Overall, the proposed framework outperformed in classifying the images compared with the state-of-the-art deep learning and the traditional machine-learning-based classifier